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We undertake a systematic study of the dynamics of Boolean networks to determine 
the origin of chaos observed in recent experiments. Networks with nodes consisting 
of ideal logic gates are known to display either steady states, periodic behavior, or 
an ultraviolet catastrophe where the number of logic-transition events circulating 
in the network per unit time grows as a power-law. In an experiment, non-ideal 
behavior of the logic gates prevents the ultraviolet catastrophe and may lead to 
deterministic chaos. We identify certain non-ideal features of real logic gates that 
enable chaos in experimental networks. We find that short-pulse rejection and the 
asymmetry between the logic states tends to engender periodic behavior, at least 
for the simplest networks. On the other hand, we find that a memory effect termed 
"degradation" can generate chaos. Our results strongly suggest that deterministic 
chaos can be expected in a large class of experimental Boolean- like networks. Such 
devices may find application in a variety of technologies requiring fast complex 
waveforms or flat power spectra, and can be used as a test-bed for fundamental 
studies of real-world Boolean-like networks. 
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1. Introduction 

Boolean models are often used to obtain insights into the dynamical properties 
of physical systems composed of elements that appear to execute binary logic. A 
paradigmatic case is the behavior of digital circuits in which physical gates are 
designed with the specific intention of executing Boolean logic. In typical circuits 
designed to carry out well defined computations, one typically introduces an exter- 
nal clock that determines when each gate is to be updated. By making the time 
between ticks of the clock sufficiently long, it is possible to make devices that ac- 
curately carry out any desired Boolean operations (von Neumann 1956). 

Computation is not the only possible use for digital circuitry, however. For some 
applications, such as private communications, remote sensing, or random number 
generation, one may want circuits that generate chaos with an ultra-broadband 
spectrum. One approach to creating such circuits is to do away with the clock and 
allow each gate to respond continuously to its inputs. The analog characteristics 
of the response at very high frequencies, along with the different signal propaga- 
tion delays between the gates, can then lead to complicated dynamics that may 
or may not be captured by Boolean models. We call such devices autonomous dig- 
ital circuits. We wish to understand the potential sources of chaotic dynamics in 
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Figure 1. (a) Topology of the chaotic Boolean network investigated by Zhang et al. (2009) 
and truth table for logic operation performed by the nodes 1, 2 (xor), and 3 (xnor) on 
their respective inputs, (b) Temporal evolution of the voltage at one point of the chaotic 
network. 



autonomous digital circuits and other physical systems involving interactions with 
similar characteristics. 

An autonomous Boolean network (ABN) is a set of nodes with binary values 
coupled by links with associated time delays. Each node is updated continuously 
according to a designated Boolean function of the values of its inputs at the ap- 
propriate previous times. If nocic^ A receives an input from node B, we refer to A 
as a "target" of B. In principle, the time delay between the switching of node A 
and its target B is due to a signal propagation time on the link, which may depend 
on whether the switch was a rise (from OFF to on) or a fall (from ON to off). 
It is also possible that the processing time at B depends on the state of all the 
other inputs to B at the time the signal arrives. In general, we expect a nominal 
time delay associated with each link and slight adjustments depending on what 
information is being transmitted and whether it induces activation or decay of the 
target node. Moreover, it is known that the set of attractors of a network can be 
influenced by memory effects (Norrell et al. 2007), which can be modeled in ABNs 
as a dependence of the time delays on the amount of time that the receiving node 
has been in its current state. 

The present communication is motivated by recent experiments by Zhang et al. 
(2009) , who constructed an autonomous digital circuit using commercially-available, 
high-speed electronic logic gates. The topology of their Boolean network is shown 
in Fig. 1(a). It consists of three nodes that each have two inputs and one output 
that propagates to two different nodes. The time it takes a signal to propagate to 
node j from node i is denoted by Tji = 1,2,3). Nodes 1 and 2 execute the 
Exclusive-OR (xor) logic operation, while node 3 executes the XNOR (see truth 
tables in the Fig. 1(a)). There is no clock in the system; the logic elements process 
input signals whenever they arrive, to the extent that they are able. They observed 
that the temporal evolution of the voltage at any given point in the circuit has a 
non-repeating pattern with clear Boolean-like state transitions, displays exponential 
sensitivity to initial conditions, and has a broad power spectrum extending from dc 
to beyond 2 GHz. Fig. 1(b) shows the voltage at the output of node 2. Because the 
circuit includes feedback loops with incommensurate time delays, it spontaneously 
evolves to dynamical states with the shortest possible pulse widths, a regime in 
which time-delay variations generate chaos. 

Zhang et al. (2009) also demonstrated using numerical simulations that an ABN 
model can account for the major features observed in their network. Our goal here is 
to use analysis and numerical simulations to identify the possible sources of chaos 
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Figure 2. The network of primary interest in this paper. 

in simple ABNs and thereby clarify the origins of chaotic dynamics observed in 
autonomous digital circuits. In this paper, we focus on the simplest network that 
yields nontrivial behavior - a single XOR gate with two output links that both feed 
back to its own inputs, shown schematically in Fig. 2. 

There are two generic effects in Boolean circuits that dramatically alter the 
attractor structure. First, the time delay on the link from B to A depends on 
whether A and B are switching ON or off (Norrell et al. 2007), as mentioned above. 
We refer to the special case in which time delays do not depend on the direction 
of the switches as symmetric. Second, the nodes in the network cannot process 
pulses of arbitrarily short duration; pulses shorter than some cutoff dm-ation Tgpr 
are filtered out so that they never reach the next target node (Klemm & Bornholdt 
2005, Norrell et al. 2007). A pulse is defined as two consecutive state transitions of a 
single node. The pulse width is the temporal separation between those transitions. 
If a transition turning a node OFF (or on) were to occur earlier than Tgpr after a 
transition turning that node ON (or off), the system evolves as if neither transition 
had ever occurred. We refer to this effect as short-pulse rejection and assume it is 
present in all cases. 

We use the term symmetric ABN, or SABN, to refer to a system with a short- 
pulse rejection mechanism and time delays that are independent of input and target 
states and their histories. In the limit Tgpr 0, our SABN is equivalent to the 
Boolean Delay Equations discussed by Ghil and collaborators (Dee & Ghil 1984, 
Ghil & MuUhaupt 1985, and Ghil et al. 2008). 

A third effect that turns out to be quite important is the dependence of the 
time delay along a link on the state of the input node and its recent history. This 
has been termed the "degradation" effect because it typically takes the form of a 
variation in delay time for switches at the trailing edge of pulses near the short- 
pulse-rejection limit (Bellido-Dfaz et al. 2000). We will see below that this effect is 
necessary and often sufficient to generate chaos in simple networks. 

This paper is organized as follows. In Section 2 we establish notation and some 
useful definitions and discuss the periodic behavior of networks with only a single 
feedback loop with no degradation effect. In Section 3, we show rigorously that the 
symmetric two-loop XOR system with no degradation can have only periodic (or 
fixed point) attractors. In Section 4, we argue that chaotic behavior should not be 
expected in any system in the absence of a degradation effect, though we cannot 
rule out the possibility entirely. In Section 5, we present a numerical model of a 
degradation effect in the simplest possible feedback system — a single copier node 
with a self-input — and show that it can produce chaos. Finally, in Section 6, we 
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Figure 3. A network with one feedback loop. White nodes form the loop. Dark nodes may 
determine whether nodes in the loop act like copiers or inverters. Light gray nodes are 
slaved to the dynamics of the loop and do not influence it in any way. 

present numerical results elucidating the nature of the chaos that appears in the 
XOR system when degradation effects are included. 

2. Single loops 

Assuming that there are no time-varying external inputs to the network, a purely 
feed-forward network will have only fixed point attractors. Any persistent periodic 
or chaotic oscillations in the system must be driven by some sort of feedback loop 
or combination of multiple feedback loops, where a feedback loop is defined as a 
ring of any number of nodes that allows a signal generated at one node to propagate 
back to the input of that node. The simplest case is a single node that is its own 
target. 

The basic structure of a network containing a single loop is one ring of nodes, 
each of which either copies or inverts its input. The system may also contain addi- 
tional nodes that are targets of one or more nodes on the ring, and these targets 
may themselves have additional targets forming feed-forward subnetworks that lead 
to dead ends. Finally, the nodes on the ring may have additional inputs that are 
controlled by feed-forward chains. These nodes may determine whether each node 
on the ring acts as a copier or an inverter. (See Fig. 3.) 

To explain the behavior SABNs containing only one feedback loop, we introduce 
some definitions and notation. Consider a loop of A'' nodes in which node i is an 
input to node i + 1 and node A'' is an input to node 1. Let tba designate the time 
delay associated with the link with input B and target A. We refer to each switch 
from OFF to ON in a time series of any given node as a positive kink and each switch 
from ON to OFF as a negative kink. A kink may be thought of as propagating along 
a link and then being processed by the target node. 

A copier transmits the kink to its outputs and an inverter changes the sign of 
the kink before transmitting it. At any given instant, there may be many kinks on 
the loop. There is a topological constraint, however, depending on whether the loop 
has an even or odd number of inverters. We use the terms even loop and odd loop 
to distinguish these cases. On an even loop, the single-valued nature of each node 
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forces the number of kinks to be even. On an odd loop, the number of kinks must 
be odd. 

To specify a state of the system, wc must specify a continuous time scries for 
each node over a time interval [t — r^-i i, t]. We will see later that this is important 
for measurements of trajectory divergence. For now, we simply note that all N 
such time series must be specified as an initial condition in order to determine the 
subsequent dynamics. The system state specified by the initial conditions may be 
visualized as a number of kinks that are propagating along their respective links at 
time t and will reach their targets before any signal from their input nodes can. 

Let Tioop = Tjv,i + ^iLi^ be the sum of the time delays on all links in the 

loop. For any initial condition, if Tspr is set to zero, then every kink present moves 
aroimd the loop in time Tioop- On an even loop, the system will return to its original 
configuration at this time. On an odd loop, the configuration a,tt = rioop will be the 
inversion of the original and the system will be periodic with period 2rioop- Setting 
Tspr to a nonzero value results in the elimination of pairs of opposite sign kinks that 
are separated in time by less than Tspr- Once all such pairs have been eliminated, 
short-pulse rejection mechanism plays no further role and the system is periodic. 

Allowing different delay times on each link for kinks of different signs causes a 
dramatic reduction in the number of attractors. The time required for a positive 
kink beginning at a given site to make a full circuit and return to that site will be 
different (in the absence of fine tuning) from the time required for a negative kink 
to return. Thus, if there are two kinks in the system, one will catch up to the other, 
eventually leading to a pulse of width smaller than Tgpr, which will be annihilated. 
In an even loop, all pulses will eventually annihilate and the attractors will always 
be fixed points in which all nodes hold steady values consistent with their input. 

The case of odd loops is more complicated. When a positive kink propagates 
around the loop once, it is converted to a negative kink. Thus, a kink of either sign 
will take exactly the same time to propagate around the loop twice. If a pulse is 
wide enough to avoid annihilation during the time required for the two traversals, 
it will return with no change in its width. A pulse of this type, however, is only 
marginally stable. If the width of the pulse is perturbed, there is no mechanism 
for restoring it to its original value. In a system where noise causes small random 
fluctuations in the delay times, the width of a pulse will execute a random walk 
and the pulse will eventually collapse due to short-pulse rejection. Because of the 
topological constraint, there will always be one kink left that cannot be annihilated, 
and it will propagate, creating a unique oscillatory attractor. 

Thus, we see that SABNs are special in that they admit a large set of marginally 
stable attractors that collapse to a much smaller set for arbitrarily small symmetry 
breaking (in the even loop case) or noise (in the odd loop case). We will return to 
the asymmetric case later. For now, we continue the discussion of SABNs. 

3. Two loops 

We next consider the simplest possible (nontrivial) system with two feedback loops: 
a single XOR gate whose two inputs come directly from its own output, shown 
earlier in Fig. 2. The output of an XOR gate changes its value every time one of its 
inputs changes, so that kinks propagating through this network can be annihilated 
only through short-pulse rejection. If the XOR is replaced with any two-input logic 
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function other than NOT XOR, the dynamics leads quickly to a fixed point or a very 
simple oscillation, as can be checked by inspection. The NOT XOR case is identical 
to the XOR under exchange of the meaning of ON and off. 

The dynamics of the system is defined by a Boolean delay equation for the 
state x{t), together with a procedure for rejecting short-pulses. The Boolean delay 
equation is 

X{t) =x{t-Tl)(Sx{t-T2). (3.1) 

Let e be an infinitesimal duration. To implement short-pulse rejection, we adjust 
x{t) as follows. If x{t) 7^ x{t — e), indicating that a switch has occurred at time t, 

and /J"""" x{t — s) © x{t — e)ds =/= 0, indicating that the gate has switched sometime 
during the past short-pulse rejection interval, then x{t — s) = x(t — Tgpr) for all s 

in [0,Tspr). 

In the two-loop case, it is not obvious that the attractors must be periodic. Ghil 
and co-workers have studied the case of no short-pulse rejection and noted that 
the system exhibits an ultraviolet catastrophe in which kinks become dense in time 
and pulse widths tend toward zero (Ghil & MuUhaupt 1985, Ghil et al. 2008). The 
short-pulse rejection mechanism in our SABNs eliminates kinks that are too close 
and thereby regularizes the divergence. The following theorem shows that what 
remains can only be periodic. We count the trivial always-OFF fixed point as a 
degenerate case of a periodic attractor. 

Theorem 3.1. For a SABN consisting of a single xOR with two self-inputs having 
delays ri and T2 (as shown in Figure 2), the attractors are always periodic. 

Proof: We will first show that the attractor reached when the system is initiated 
with a single kink is always periodic. We will then show that the introduction of 
additional kinks in the initial condition cannot alter this result. 

Assume, without loss of generality, that ti < T2. Let t^, for s = 1, 2, . . . represent 
the times that the output of the gate switches, and define the intervals between 
switching times as Ag = ts — tg-i- Now note that the future of the system is 
determined if a past sequence of switching events spanning a duration of T2 (the 
extent of the memory encoded in the longest delay line) is specified. The strategy 
is to show that the set of possible sequences Ag for Si < s < S2 is finite for values 
of S2 — si corresponding to tg^ — tsi < T2. If this is true, the system must eventually 
revisit some sequence that is long enough to determine its future behavior, which 
immediately implies periodicity. (Any deterministic system with a finite number of 
states must have only periodic or fixed point attractors.) 

Consider a system initialized by a single kink at time to = 0. That is, the gate 
is assumed to be OFF for all times less than to and switched on at to- Each time the 
kink propagates around one of the delay lines, it causes the output of a new kink. 
Thus, kinks could conceivably be generated at times 

ti,j=iTl+jT2 (3.2) 

for any positive integers i and j. It is convenient to represent these times as sites 
of a lattice - the dots in Fig. 4 (Ghil & Mullhaupt 1985). The vertical axis in the 
figure represents time. The horizontal axis is not physical. It simply provides a way 
to visualize the causal processes that generate kinks. Moving down and to the left 
from a given site leads to another site a time n later. Moving down and to the right 
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Figure 4. Example of a lattice of possible switching times and the pattern of actual switch- 
ing times after short-pulse rejection effects arc taken into account. The vortical spacings 
corresponding to ri, T2, and Tspr are shown. The two arrows near the top of the lattice 
indicate two kinks that arrive simultaneously at a dot and therefore produce no outgoing 
kink. The grey vectors indicate minimal rejection pairs. The circled dots represent the 
events that actually occur. 

leads to another site a time T2 later. Note that the full set of sites is an infinite wedge 
subset of a Bravais lattice. We refer to a given site and its corresponding event by 
the pair that specifics the time the event occurs according to Eq. (3.2). 

Event may not actually occur because some kinks are annihilated by the 
short-pulse rejection mechanism. If events arc generated at and (fc, £) for which 
\ti,j — tk,i\ < Tspr, a pulse will be created that is too short to pass through the 
gate. Thus, those two events will not generate any future events. To trace out the 
dynamics on this lattice, we begin by circling the top site, (0,0). We then circle 
(0, 1) and (1,0), indicating that events will occur at the corresponding times. For 
each event (i, j) that occurs, we circle the two events (i, j + l) and The sites 

are circled in chronological order, and, if the time interval between a newly circled 
site and the last one circled is less than Tgpr, both circles are removed, indicating 
that neither event actually occurs. A degenerate case arises when a single site gets 
circled twice - once from each of its upstream neighbors. This represents two kinks 
arriving simultaneously, which does not cause a switch in the output of the XOR 
gate, so the site does not get circled. Figure 4 shows an example. 

We now show that there is an upper bound to the horizontal distance between 
two circled sites that are vertically separated by less than t2. That is, if \tij—tk,e\ < 
T2, then lA; — i| + \j — i\ is bounded from above. Let D be the smallest horizontal 
distance between two events that are vertically separated by less than Tspr; i.e., 
D is the smallest value of m + n for which \mTi — nT2\ < Tspr- In the case shown 
in Fig. 4, I? = 5 (from m = 3 and n = 2). The vector joining two such sites 

is f min 

= {D, mn - nT2). We will refer to a pair of sites separated by 

^min as a 

"minimal rejection pair." 



Article submitted to Royal Society 



8 



H. L. D. S. Cavalcante et al. 



If T2/T1 is rational, the lattice contains multiple sites that occur at exactly the 
same time and are separated by a minimal horizontal distance W. {W is equal to D 
if and only if Tspi- is siifficiently small.) Wc may identify such points, thus turning 
the lattice into a strip of width W having periodic boundary conditions - a cylinder 
of circumference W. At any given time t, the configuration of circled sites lying in 
a band between t — T2 and f. determines the future evolution uniquely. Without 
loss of generality, assume that t coincides with a lattice site. Because the sites form 
a Bravais lattice, the configuration of lattice sites within the band is finite (and 
unique). The number of possible configurations of circled sites is therefore finite, 
which ensures that the system must eventually revisit some configuration that it 
has already passed through. The subsequent evolution will then cycle periodically 
through that configuration. 

For the case of irrational T2/T1, there are no pairs of sites that occur at exactly 
the same time. Nevertheless, we can prove that the set of circled sites must be 
confined to a region whose width never exceeds D, so the number of accessible 
configurations is again finite. The proof proceeds by contradiction. Assume that 
there are two circled sites separated vertically by less than t2 and horizontally by 
more than D. Because no two sites sit at exactly the same time, each circled site 
must be connected to (0, 0) by an unbroken chain of circled sites that caused it. But 
any two such chains that begin from sites separated by more than D must contain 
a minimal rejection pair. To see this, consider any two paths starting from the 
same site. Let {ir,jr) with r = 0,1 . . .R denote the sites on one path, and {kg, is) 
with s = 0, 1 ... 5 be sites on the other. Define (/x, i')r,8 = {kg — irAs — jr), where 
(M; ^)o.o = (0, 0). Each step on either trajectory either changes or by ±1. Thus, 
the set {(/z, J/)} must contain every possible pair with ^ < kg — ir and v < — jr- 
Now, assume that the paths contain sites corresponding to times that difii'er by less 
than T2 and having a horizontal separation greater than D. Let {iR,jR) be the site 
on the left and {kg, is) be the site on the right, so that ir — kg and £$ — Jr are 
both positive. We then have 

{iR-ks) + {ts-3R)> D (3.3) 

and 

\{lR - ks)Tl - {is - Jr)t2\ < T2. (3.4) 

Recall that {m,n) gives the minimal rejection pair. If {Ir — ks) < m, Eq. (3.3) 
requires {is — Jr) > n, which implies that Eq. (3.4) must be violated, as can 
be seen immediately by comparing to the known relation mri — nT2 < Tgpr, with 
Tspr < T2- Similarly, {is — Jr) < n requires {ir — ks) > m, which again implies a 
violation. Thus, we must have {Ir — ks) > m and {is — Jr) > n, which implies in 
turn that there must be some pair (r, s) for which {n,i/)r,g = {m,n). When these 
sites were circled, however, they would have been subject to short-pulse rejection. 
Hence the configuration of two chains cannot represent a possible trajectory of the 
system. 

We have proven that the dynamics initiated by a single kink must be confined to 
a tube of width D on the lattice. The tube need not be vertical or even straight, but 
it cannot have a horizontal width greater than D at any time. The periodicity of the 
trajectory then follows immediately from the fact that the number of configurations 
of circled dots that can be covered by a rectangle of height T2 and width D is finite. 
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Figure 5. A portion of tiie event lattice relevant for the proof of Theorem 3.2. The long grey 
vector indicates short-pulse rejection. The other arrows show events required to annihilate 
additional kinks generated from events A and B. 

which guarantees that some configuration will be repeated after a sufficiently long 
time, and the trajectory between these repeated configurations will then be repeated 
ad infinitum,. Figure 4 shows an example in which the trajectory repeatedly returns 
to a configuration in which only one kink is present. 

To complete the proof that all attractors are periodic, we must consider the 
possibility of initiating the system with two or more kinks. To analyze such cases, 
we overlay the lattices originating from each kink in the initial interval of duration 
T2. The (0,0) sites from the difii'erent lattices will be displaced vertically by times 
between and T2. The lattices emanating from each (0, 0) site will all be translated 
copies of the same lattice. 

To see that the entire set of events must still be confined to a tube of finite 
width, first note that any event must be connected to one of the (0, 0) sites by a 
chain of events contained entirely in one lattice. By the reasoning used in proving 
Theorem 3.1, the events on any single lattice must be confined to a tube of width 
D. The problem, then, is to show that there is an upper bound on the horizontal 
distance between circled sites on two different lattices when their vertical separation 
is less than t2. 

If T2/T1 is rational, the lattices can all be represented on a finite radius cylinder 
(or infinite plane with periodic boundary conditions at the sides) and it is clear 
that the number of configurations in a band of any given height is finite. If T2 / n is 
irrational, the proof follows essentially the same reasoning as the single lattice case. 
Consider events on any two of the lattices. There are now two minimal rejection 
vectors Vmin depending on which lattice contains the trajectory on the right (with 
larger n — m). Nevertheless, given any two widely separated points, the paths to 
each point that must pass through one of the minimal rejection separations for that 
pair of lattices. This must be true for each distinct pair of lattices, so the entire 
trajectory must be confined to a finite tube. Because short-pulse rejection prevents 
initialization with arbitrarily close kinks, the number of initial kinks is bounded. 
This means that the number of overlayed lattices is bounded, which implies again 
a finite number of configurations within a rectangle of height T2 and a specified 
width, so the full trajectory must be periodic. Q.E.D. 

Theorem 3.2. For a SABN consisting of a single XOR with two self-inputs having 
delays t\ and T2, and with Tgpr sufficiently small that no collapse to the always-OFF 
state occurs before t = T2, the trajectory will never reach the always-OFF state. 

Proof: The only way to reach the always-OFF state would be for the two last 
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events to annihilate by short-pulse rejection. That is, for the pattern of circled lattice 
sites to produce two candidates at the minimal rejection distance without producing 
any other circled dots on the interior of the minimal width tube containing the 
trajectory. Figure 5 shows that this cannot happen. When event A generates event 
C, it must also generate E, which occurs later than C and D. (We assume that E 
and D are distinct points. If Tspr is too large, the collapse can occur immediately 
because C and D are both derived from A) . In order for E to be annihilated, event 
F must be present, which in turn would generate G. Note that F has the same 
value of m + n as A. Repeated application of this reasoning shows that annihilation 
of all further events through exact coincidences would require an infinite line of 
events at the same value of i + j as A, but such a line is impossible, both because 
it would eventually reach the edge of the triangular wedge of possible lattice points 
and because it would require events occurring at later times than our supposed final 
annihilation of C and D. Thus, the always-OFF collapse cannot occur. Q.E.D. 

We now turn to the asymmetric case, in which the time delays associated with 
positive (rf ^ and r^^) and negative kinks (rf^^ and T2*^^) on any given link 
may be different. The evolution is calculated as follows. We construct a queue of 
times at which the gate switches states. Let ti be a time at which the gate switches 
from X to X. When ti is the earliest time in the queue, it is removed (processed) 
and two future times ti + Ti and t\ + T2 are added. Let the next time after t\ 
in the queue be t2- The switch at t2 causes the gate to return to the state x. If 
t2 ~ t < Tspr, then t2 is removed from the queue along with any times just added 
due to the switch at ti . Otherwise, only t2 is removed and t2 + rf and t2 + rf are 
added. If t2 +Tf < ti ■ however, then both are removed from the queue, as this 
implies that the trailing edge of a pulse overtook the leading edge as it propagated 
along the link. 

The lattice picture now becomes more complicated. We need a 4D lattice with 
one basis vector for each possible delay time. Each time a site is circled, the state 
of the XOR gate determines which two lattice directions are available for the next 
step, and the state of the gate is determined by the parity of the number of steps 
that have been taken up to the time in question. Note that the number of steps 
cannot simply be counted by tracing the single path leading to the transition of 
interest. All of the events above the one under consideration must be counted to 
determine the current state. 

The proof of the bounded width of a trajectory on the 2D lattice breaks down 
for higher dimensions. The difficulty is that it becomes possible for trajectories to 
avoid hitting pairs of points at the minimal rejection distance by moving in the third 
(or fourth) dimension. We do not (yet) have a proof that periodicity is necessary 
for the asymmetric case, but extensive numerical simulations have failed to turn 
up any counterexamples. Figure 6 shows a typical trajectory with the 4D lattice 
projected onto a plane. A step one unit to the right indicates traversal of link 1, 
with the two possible vertical displacements rf^ or rf^^, similarly, steps to the 
left correspond to traversing link 2, with delay either T2^ or T2^^ ■ Only the circled 
sites are shown. 

We also could not prove that the asymmetric system will never collapse to the 
always-OFF state. We cannot rule out the possibility that two short-pulse rejections 
can annihilate all four of the events emanating from two events separated by more 
than the minimal short-pulse rejection distances on the 4D lattice. 
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Figure 6. Typical trajectory of a two-loop ABN initialized with a single positive kink. The 

columns arc successive time intervals of 100 units and the periodic attractor is evident in 
the fourth column. The time delays for this simulation are rf"^ = 1.000, r"^^ = 1.117, 
T^'^ = 4>, and T^^^ = 1.117(^, where (p is the golden ratio, 1.618.... The short-pulse 
rejection time was Tspr = 0.040. The system was initialized with a single positive kink at 
one of the inputs at t = 0. 

4. Trajectory divergence 

In the absence of a proof that all attractors of ABNs are periodic, it is useful to ask 
how one might detect chaos in a simulation. Spectral analysis of the time series may 
be useful, but it is also possible for the periodic attractors to be extremely long and 
it may be difficult to resolve the peaks. We consider two methods for following the 
divergence of trajectories that initially differ by a small perturbation. In both cases, 
we introduce a perturbation by artificially delaying (or accelerating) the arrival of 
one kink by a small amount e. In the first method, we construct the sequence of 
switching times f„ for the original trajectory and t'^ for the perturbed one. We 
then plot 6n — \t'„ — i„| vs. t„. In the second, wc define the Boolean difference at a 
given time to be if the gate is in the same state on both trajectories and 1 if the 
states are different. We integrate the Boolean difference between the original and 
perturbed trajectories over a time window T2 (the longest delay time on a link). 
We denote the integral by d{s), where s represents the time between the applied 
perturbation and the end of the integration interval. 

It is immediately clear that the only source of trajectory divergence as measured 
by the first method is the rejection of a short-pulse in one trajectory but not the 
other. There is no other mechanism that increases or decreases the time difference 
between corresponding kinks. If there is a short-pulse rejection in one system but 
not the other, however, the pulse that makes it through could generate subsequent 
events that cause the two trajectories to diverge. In the limit of infinitesimal e, 
short-pulse rejection differences will never occur and there can be no trajectory 
divergence. 

In the second method, the distance between trajectories can grow because sev- 
eral kinks emanating from the perturbed one will also be perturbed by e. This 
distance cannot grow larger than ne, where n is the number of kinks that can be 
accommodated in an interval of duration T2. Note that n is finite for any nonzero 
value of Tspr, so again there is no exponential divergence in the limit of infinites- 

Article submitted to Royal Society 



12 



H. L. D. S. Cavalcante et al. 



imal e. Further divergence requires short-pulse rejection differences as in the first 
method. 

On the other hand, for any given e > 0, there may be a pulse eventually gener- 
ated with duration closer than e to the short-pulse rejection threshold. This effect 
could conceivably lead to exponential divergence in d over an intermediate scale 
between the short-pulse rejection time and the time required for a kink to generate 
n new ones — roughly nri. 

The growth rate of the number of kinks generated by a single kink or pulse 
injected into a SABN is known to be polynomial wlicni there is no short-pulse rejec- 
tion, with an exponent of £ — 1, where £ is the minimum number of incommensurate 
delay times necessary to express the network evolution (Ghil & MuUhaupt 1985). 
Short-pulse rejection will reduce the rate of growth as the number of kinks increases, 
however, so there will be no exponential divergence in SABNs. 

In the asymmetric case, we study numerically whether a single short-pulse rejec- 
tion occurring in one trajectory but not the other can lead to exponential divergence 
in d over an intermediate scale. Figure 7 shows measurements of In d{s) obtained 
from simulations with Tgpr = 1.0 x 10~^, where a perturbation e = 0.5 x 10~^ is 
applied at f,Q. The transition time to is chosen so that the original pulse covering to 
was just filtered by the short-pulse rejection, while the pulse with transition time 
to + e just barely survived. We average Inrf(s) over 30 pairs of trajectories with 
different initial conditions. As we see in Fig. 7, the distance grows polynomially in 
this case also. In section 3, we have proven that the SABN consisting of a single 
XOR gate with two self inputs must yield only periodic attractors, and we have 
numerical evidence suggesting that, in the absence of memory effects (other than 
short-pulse rejection), the ABN will not yield exponential divergence of trajectories 
either. 




s 



Figure 7. An average of In d{s) for the xoR gate with two delayed self-inputs and short-pulse 
rejection. The solid line is simulation data and the dashed line a fit to a power-law form 
of d{s) with exponent 1.2. 



5. Boolean chaos 

The next place to look for a source of chaos in the autonomous digital circuit is in 
the memory effects associated with the response of the gate to two successive kinks 
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Figure 8. Implementation of the degradation effect. The top curve is a schematic illustra- 
tion of the temporal evolution of a state variable. When the variable is above a threshold, 
the gate is considered to be ON. The lower curve shows the Boolean approximation of the 
input to the gate. For simplicity of illustration, we assume the gate is its own target. The 
rising kink n causes the state variable to begin a transition. The indication that it has 
crossed the threshold is transmitted through a link with time delay Tr and generates the 
rising kink at the input at fj+i. The situation for falling kinks is similar. 



that form a pulse. In principle (and in the circuit of Zhang et al. 2009), the delay 
time for a kink that is the trailing edge of a pulse can depend on the width of the 
pulse. This dependence is called the degradation effect (Bellido-Diaz et al. 2000). 

We now present numerical evidence showing that the degradation effect can 
produce chaos in the simplest of all networks, a single copier with one self-input. 
The dependence of delay times on pulse width introduces nontrivial dynamics in the 
durations of successive pulses which can lead to stabilization of pulse widths and 
numbers of kinks, and opens the possibility of chaotic sequences of pulse widths. 

To understand the origin of the degradation effect requires that we consider the 
underlying analog signal that has finite rise and fall times between ON and OFF 
states; the inherent propagation delays of signals propagating through the logic 
gates; and the associated Boolean idealization of the waveform. See Fig. 8. 

One method for implementing the degradation effect in the autonomous Boolean 
network is as follows. Let r be the time of occurrence of a rising kink and / be the 
time of the subsequent falling kink. Let r' and /' be the times of the rising and 
falling kink induced by the kinks at r and /. These times represent the arrival of a 
kink at the gate. The actual time when the gate variable switches is slightly later 
and depends on the state of the gate at the time of the arrival of the kink. That is, 
the actual switching time associated with the kink at r is r' — Tr, where Tr is the 
propagation delay. The difference between between /' — t/ and / is a function of the 
time that the gate was ON; i.e., a function of / — (r' — Tr). We define a degradation 
function g {f — {r' — Tr)) that gives the delay /' — /. 

For the case of a single pulse cycling through a single copier with a self- input. 
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we consider the evolution equations for the sequences and If the kinks are not 
rejected because of a short-pulse, fi will generate a new kink fi+i, with 

.U+i = fi + g/ifi - {n+i - Tr)). (5.1) 

Similarly, for a rising kink, we have 

r-i+i = n + grin - {fi - Tf)). (5.2) 

In principle, the constants Tr and t/ need not be equal and the functions gf and gr 
may be different. Because we are interested only in showing the existence of chaos, 
we will consider only the most tractable case: t^- = r/ = r and g^. = gf = g. 

It is convenient to rewrite the evolution in terms of the pulse widths. Defining 
Wi = fi- n and Vi = r^+i - fi, Eqs. (5.1) and (5.2) give 

Wi+i = Wi + g{T - Vi) - g{T - Wi) , (5.3) 
Vi+i = Vi + g{T - Wi+i) ~ g{T - Vi) . (5.4) 

From Fig. 8, one sees that Wi determines Vi in a manner required by Eq. (5.2); 
g{T — Wi) — Wi = Vi, which implies a constraint on the possible initial values and 

allows the map to be reduced to a single variable, say v. Substituting this relation 
into the expression for w^+i (Eq. (5.3)) and inserting the results into Eq. (5.4) gives 

Vi+i =Vi + g{T + Vi- g{T - Vi)) - g{T - Vi) = h{vi) . (5.5) 

A stable fixed point of the map (5.5) corresponds to periodic behavior in which every 
pulse has the same width w* and every dip has the same width v*. Equation (5.3) 
implies g{T — v*) = g{T — w*), but this does not necessarily imply w* = v*. 

The function g{x) should satisfy two constraints. First, g{x) > r for all x because 
r is the minimum delay time required for traversing the link. Second, g(x) should 
asymptote to some constant tq > r for large x because the gate will settle into 
a fixed state if its input is held constant for a long enough time. By trial and 
error (based on intuition gleaned from experimental studies of the response of real 
electronic gates), we identify a function g{x) that generates chaos in the simple 
copier model considered here. It is given by 

g{T — v)=T + a + b{T — V — c) exp (— (r — v)/A) , (5.6) 

with r = 1.3, a = 0.26, b = 13.0, c = 0.02, and A = 0.18. Figure 9 shows the form 
of g{x), the sequence of values Vi that it generates through Eq. (5.5), and scatter 
plot of Vi+i as a function of Vi. The latter falls on a ID map given by Eq. (5.5). 
Note that neither v nor w ever takes on a value smaller than « 0.5, so the dynamics 
is consistent with a short-pulse rejection mechanism with Tgpr less than this value. 
We have run the map for 10^ iterates and have not seen any evidence of periodicity. 
The Lyapunov exponent for ID maps can be calculated by 



Adiscrete = Hm — In 



^ ' dh{vt) 



N-yoo N 

i=l 



dvi 



(5.7) 



where Vi is a fiducial trajectory, calculated numerically from the map evolution 
equation (Eq. (5.5)). 
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V. s 

Figure 9. (a) The degradation function g{x) for the chaotic copier, (b) The sequence of 
values Vi is chaotic, (c) The plot of Vj+i vs. Vi shows a clear ID relation, (d) Average of 
Ind(s) over 121 trajectories. The dashed line is a fit to the region of exponential scaling. 

With N = we obtained Adiscrotc ~ 0.787 for the same parameters used 
in Fig. 9. As Adiscrete gives the average expansion rate per cycle of the continuous 
system, we relate this Lyapunov exponent in discrete time to the maximum positive 
Lyapunov exponent A in continuous time by A = Adiscrete/?", where T is the average 
cycle duration (T^ = Wi + Vi). Using this relation we can test the assumption of 
Zhang et al. (2009) that the Boolean distance d{s) grows as exp(As). We measure 
T f» 2.12 from the discrete time series and, from the Boolean variable in continuous 
time, we calculate the average of \nd{s), shown in Figure 9(d). In this section, 
however, instead of applying a perturbation to pairs of trajectories, as described in 
the previous section, we look for segments of the time series with an initially close 
Boolean difference, to reproduce the method in Zhang et al. (2009). In the region 
of exponential growth, (Ind(s)) is fit to a straight line with slope A = 0.37, in good 
agreement with the ratio Adiscrctc/T ~ 0.371. Details of the use of d{s) for precise 
measurement of the largest Lyapunov exponent have yet to be worked out, but the 
good agreement between A and Adiscrete/?" indicates that the exponential growth of 
d{s) is a reliable indicator of chaos. 

Our simulations show that a simple copier with an appropriate form for the 
degradation effect can generate a chaotic sequence of pulse widths. We have ob- 
served chaos with other parameter values and other choices of the degradation 
function g{x), but the analysis of the map in Eq. (5.5) for arbitrary g{x) is difficult. 
Two criteria are necessary for chaos (though not sufficient): the trajectory must not 
visit the vicinity of a stable fixed point of the map; and it must not visit v < Tgpr 
or a value of v such that the corresponding w < Tgpi- for whatever choice of Tgpr 
one takes to be of interest. Analytic expressions for these conditions are not easily 
determined. 

In this section, we have shown that a simple, single-loop Boolean network (a 



Article submitted to Royal Society 



16 



H. L. D. S. Cavalcante et al. 



copier with self-feedback) shows chaos when the degradation effect is taken into 
account. In related work, chaos has also been observed in hybrid models with con- 
tinuous variables governed by equations of the form dxi (t) / dt = Fi (x) — Xi (t) , where 
is a binary- valued function (Mestl et al. 1996). From the perspective adopted in 
the present paper, such models may be thought of as explicit definitions of the 
underlying dynamics that producx's degradation effects. They arc special cases, 
however, in that they do not include explicit time delays (or, alternatively, explicit 
descriptions of the propagation of signals along links). 

Glass et al. (2005) have studied an electronic circuit explicitly designed to imple- 
ment the hybrid model dynamics proposed as a model of a 5-node gene regulation 
network. In their circuit, the output of each logic gate is used to charge a capacitor, 
thereby simulating one specific form of a degradation effect. They derive an approx- 
imate analytical solution for the response of the analog voltages in the circuit and 
show that the resulting map produces chaos. The 10 ms time constant introduced 
by the capacitor in their circuit is much slower than the switching times associated 
with the gates that implement the functions Fi or the signal propagation times 
(typically on the order of tens of nanoseconds) and thus avoids the necessity of 
accounting for time delays explicitly. Formally, this is equivalent to setting the time 
delay parameter t in our model to zero. The full dynamics of the hybrid system can 
be analyzed in this case without the need for a Boolean delay model of the type 
discussed in the present work. 

Here, we treat the system variables as Boolean and account for the analog 
behavior through the effect of degradation on the time delays between gates. Our 
method is potentially more flexible because we can incorporate a wider range of 
degradation functions that might arise in any particular model of the underlying 
dynamics and is applicable in cases where propagation delays are important. Except 
for pulses near the short-pulse rejection limit, the variations due to degradation are 
small compared to the explicit delay r. Further investigation of the relation between 
the circuit and models of (Glass et al. 2005) and (Mestl et al. 1996) is beyond our 
present scope, but may prove interesting. 



Returning to the XOR system, we now show that a simple form of the degradation 
effect can generate chaos there as well. The situation is not entirely analogous to 
the single copier studied in the previous section because the two loops tend to 
create more pulses of rather short duration and more possibilities for short-pulse 
rejections, both of which could strongly influence the trajectory divergence rate. 

In our simulations of the symmetric ABN with a single xOR we use the degra- 
dation functions shown in Fig. 10(a) for the two links. Here, for ease of simulation, 
the delay times are given by a piecewise-lincar function of the input pulse width. 
After calculating the time of a transition event using Eq. (3.1) we calculate the 
input pulse width and correct the time delays according to the equation 



6. Boolean chaos in two loops 




(6.1) 
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where a; is a pulse width, A = 1.50, xa = 0.10, xb = 0.90, and Tj. assumes either 
the value n = 9.58 or t2 = 10.75, depending on which link is being traversed. 
Pulses shorter than rgpi- = 0.10 arc cutoff, as described previously. Wc find that the 
details of the shape of the functions do not matter for the results presented below. 

Our simulations show that the system oscillates indefinitely without falling onto 
a periodic orbit or collapsing to the always-OFF or -ON states. Wc use the two meth- 
ods described in Sec. 4 to analyze the trajectory divergence. An extremely small 
perturbation e = 10~^ was applied to a given orbit. Figure 10(b) shows the Boolean 
distaiic;c rf(.s) avc^ragcxi over 100 pairs, clearly indicating a substantial exponentially- 
increasing regime. Figure 10(c) shows the evolution of the difference 5n = t'^ — tn 
between one pair of original and disturbed trajectories. The difference <5„ increases 
exponentially, as expected for an adequate definition of distance between trajec- 
tories in a chaotic system. Therefore, we conclude that chaos, as defined by an 
exponential sensitivity to differences in the initial conditions, can be achieved by 
either one-loop or two-loop ABN only in the presence of degradation effects. Both 
Sn and d{s) are useful to distinguish the qualitative dynamics and to estimate the 
largest Lyapunov exponent of the system. Both quantities grow exponentially in 
the chaotic case and polynomially in the periodic case. 




1 2 3 100 200 50 100 150 



X s n 

Figure 10. (a) Piecewise-linear degradation functions used on the two-loop system simula- 
tions. The solid and dashed line are the delays of links 1 and 2, respectively, (b) Average 
over 100 pairs of trajectories of the logarithm of the Boolean distance d{s). The dashed 
line is a fit to a linear function of slope A = 0.071. (c) Logarithm of the timing difference 
6n between one pair of perturbed and unperturbed trajectories. 



7. Conclusions 

Motivated by the recent experiments of Zhang et al. (2009) where chaos was ob- 
served in an autonomous Boolean network, we studied systematically the dynamics 
of various simple Boolean networks. From previous work on Boolean Delay Equa- 
tions, it is known that Boolean networks whose nodes obey ideal Boolean rule 
display steady or periodic behavior, or display an ultraviolet catastrophe where the 
number of kinks circulating in the network per unit time grows as a power law. 
Hence, chaos is not possible for such a network. The ultraviolet catastrophe is obvi- 
ously prevented in experiments due to non-ideal behavior of the logic gates. These 
effects include short-pulse rejection, asymmetry between the logic states, and the 
degradation effect. We first considered only the effect of short-pulse rejection for a 
network consisting of a single node and a single loop (link). We proved that only 
periodic behavior is possible. We then considered the case of a network consisting 
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of a single node executing the XOR function with two loops, which is known to dis- 
play an ultraviolet catastrophe. Even in this case, short-pulse rejection renders the 
behavior periodic. The situation is less clear when wc take into account both short- 
pulse rejection and asymmetry between the logic states. While we were unable to 
prove that the two-loop network is always periodic, numerical simulations suggest 
that this is the case. Finally, wc showed, through numerical simulations, that chaos 
is possible for even the simplest network consisting of a copier and a single loop 
when the degradation effect is included in the model. Chaos is also displayed in 
the two-loop XOR, network when the degradation effect is taken into account. Given 
that a degradation effect is present at some level in any real network, our results 
strongly suggest that there exists a class of experimental Boolean-like networks, 
containing at least one xOR connective and feedback loop, whose elements would 
display deterministic chaos. 
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